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Abstract 



This pilot study investigated differences^ in the scores of two 
groups of 2nd graders and two groups of 4t:h graders who were 
tested using television administration vs teacher administra- 
tion of the same reading ai?t osoir.ent instrument. Null hypo- 
theses concerning test scores for both gr.^de levels were re- 
jected in favor of the teacher-ad.aiui. tratio." irode. Teacher- 
administrators appeared to prefer the teacher-adniinistration 
mode while teacher-monitors in T,V. groups appeared to have a 
positive attitude toward T.V. testing. 

This study v/as conducted to examine the feasibility of using the four 
channel I. T.V. network in Palm Beach County as cj means of standardizing 
count>vide testing. One objective was to test the hypothesis that scores 
obtained in group T.V. administration (T^V.A*) would not differ significantly 
f*-om those obtained with teacheir-admiaisLiaLion (T.A.) of a Florida Reading 
Assessment instrument. The investigators believed that greater standardi- 
zation and student effort would occur and resulting test scores might be 
raised if teats were administered over television. 



In a stuv-y using English-^speakirig Hawaiian students wnose IQ's averaged 
123, Fargo cL^aJ.^ (1967) found a slightly significant difference between 
"individually administered" and "T.V. administered" Peabodv Picture Vocabu- 
lary Test scores. The results of the study favored "individual administra- 



Rulated Studies 



tion 



Another ^ tudy fuund no siguUicant difference between "T,V." and 



1 



ceacher udaiinisLratioa" (HopVin^: al,, 1967). Both stuuics reported 
iniplicaLionb pertaining l:o l:he standardization procedures for testing. 

In comparing 'i.V. and audio K-Lin^^ Stalliags (1972) found no signifi- 
cant difference in wean scores on the Modern Language Association French 
Listening Examination, But attitudes of students toward being tested by 
television was slightly unfavorable. 

Method 

In May 1972, tvro reading asses&nient instruments, specially prepared 
from the Florida Reading Assessment sample items, were administered to 
second and fourLh gride students in two groups of schools in Palm Beach 
County, Nine treatment and seven control group schools and teachers were 
telecttHl froi'' fifcy-five (33) schools in a stratif ied-cluster sampling 
procedure, Tlie experimental groups viewed a T,V* oral reading of the 
iteiiis in the :iecoud or fourth grade assesSKient instrument by a T,V, 
narrator (T.V.A.). Students responded to the T.V, narrator by checking a 
square under an appropriate picture in an answer booklet while their 
teachers monitored experimtuital classes. The control groups were adminis- 
tered the same second or fourth grade instruments by classroom teachers 
who read items to the studc^nts from identical scripts while students 
responded on idencical answer booklets (T.A.). Hypotheses predicted no 
difference in test scores between er.perimental and control groups at each 
grade level. Two tailed t ration were calculated to compare means at the 
,05 level of confidence. 

In addition, an attitude que ;tionnaire (Table I) was prepared and 
administered to the teachers of the oontxol and experimental classes* 



Tv.ji.Ly'£oar null ir/pot;ho.>j& were pLOpo-jed for t e »cv'^u ite.i3 and compiled 
tot-cii scores. Fight of tn*^ , )) p^-Opoyed di x ',c-r' r.oc between 

expGi:in.e n.ai. ct- I control ^^LOi.p r.c vies in the Cocali: aud lk-. seven items, 
TVie rt.n^t-'rxi? V ^.i ^teeii (r ^ P^, ^ P., * ) proposed that the five 

alttrncvtive choices were «iqualiy attractive in the cotals and tiie 7 items 
for both groups ^ 



TEACHER ATIITUDES TOWAKD THE ADMID^ISTKAIION 
OF STANDARDIZED EXAMS via I*T.V. 

Hereinafter the adiainistration of standardized exams over I.T.V, shall 
be called "T.V. testing". Please attempt to respond to each of the items 
below as you truly feel. Read every item first and chen place a check 
mark (>^) in the column opposite each item which best describes your atti- 
tude, (s.A, =^ Strongly Agree, A, - Agree, U, = Undecided, 
D, = Disagree, S,D, = Strongly Disagree) 

12 3^5 
S,A. A, U, D, . S.D. 

1* i approve of T,V« testing, 
2a I prefer testing in a classjcooiii vith 

the adrainistration done over a public 

address system, 
3o I prefer testing in a cLaauic^iii with 

administration by a teacher. 

4, I prefer testing in large groups in a 
cafeteria • 

5, I prefer testing in large groups ia a 
library or an equally quie** location, 

6, I believe T,V# testing Involves too many 
problems such as equipment scheduling 
and ! reakd >wn, 

7, I like the idea of T.V, testiag using 
Spanish-j.peaking students, 

8v List >our suggestions for iiiipi: ^. in^ 
T,V, testing or other techniques. 

Using the 1-3 scale a t r<?tio biawjca e::perimental and control group 

means was calculated for each item and tho total score (Ho: = X^, <=C = ,05), 

In calculating the tucal it ^?3P a,ssi!!ne<^ iilv^t: items two through six were the 

negative of responses to items one and sevtn and the scale was reversed accord- 

ingly. 




choices (i^U 2v» r.^- i ; ^> - l^; c> l.rzz^h e ♦ ' • i.ested using a chi- 

square gc»o<ine - ol . ii: .Ku \ ' i. y 



1 



t/ar lit r 



.2 



ie* Ihe oi l/ oignifi- 
J. ...n Cc7]c.ulated 



gordm^sG of tLL £:cl l *\ ' the 1 . . . c f ^ 
isses-nnv- xi -^t. .i.a-hV .v- . .1 • mi 'it:<'d j : o-y..) I, 'JabJ^ III, The 



• c r b o J . *i i r i ^ , • r e I s v : rc)e c t o j 
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X Cjodiiesb oi Valaijft vi Each Item Over 

Each Group ot Teachers on Attitudes Toward 
Exains via TV 



Item ;/ 


Group 




P 


Question 


Oonclusion 


1 


Coat . 


5.7499 
6 .5156 


>.10 
>.10 


Approve T.V« testing 


N.S. 
N.S. 




E.KP . 

lit- 


17.1718* 
10.8364* 


<.01 
<.05 


Prefer P„A. SystomJ 


Opposes classroom 
administration using 
Public Address Sys- 
tem^ 


3 


Exp • 

Com:, 


7.0832 
35.9218* 


>.10 
^.01 


Prefer classroom 
teachers administra- 
Uon? 


N.S. 

Favors teacher 
adpiinistraCiop 


4 


Exi , 
Cont . 


5^8332 
1?.4218* 


>.10 
<.01 


Prefer large group 
in cafe.? 


N,S. 

Opposes large group 
administration in 
cafeteria. 


5 


Exp. 
Cont. 


4.4165 
0,0312 


>.10 
<.10 


Prefer large group 
in library? 


N.S, 

Tends to oppose larg( 
group administration 
in a library. 


G 


Exp • 
Conr . 


5 . 8332 
12.7656* 


> .10 
< .02 


Feel that l.V» test- 
ing has too many 
problems'^ 


N.S« 

' Feel that T,V. test- 
ing involves too 
many problems. 


7 


Exp. 
Cout . 


5.8332 
7.4531 


> .10 

>.10 


Prefer T.V. testing 
by Spanish narrator 
for Spanish student 


N.S. 

N.S. 


Total 


Exp» 

ConJL*^ 


20.9521* 
6,3132 


< .01 

>,X0 




Favors T.V. testing 
N.S. 



JjExp. = 15 Yates correction for continuity was used in 

Cont a * 16 calculating X" values. 
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TABLE III 





DISTRIBUTION OF SCORES FOR SECOtfD GRADE 








Standard 








Samle Size 


Deviation 


Mean 


t Ratio 


T.A. 


142 


2.31989 


19.21 


4.6529* 


T.V.A. 


207 


2.53285 


17.99 






DISTRIBUTION OF SCORES FOR FOURTH GRADE 








Standard 








Sample Size 


Deviation 


Mean 


t Ratio 


T.A. 


146 


2.32538 


17.36 


4.2449* 


T.V.A. 


223 


2.75198 


16.23 



significant at Che .05 level 

Concluslen and Implications 



In Che absence of other controls It would appear that students In 
Palm Beach County do not do as well when a test Is administered over tele* 
vision as they do i^en their teacher administers the test. Furthermore, 
there Is some evidence that teachers of: 

(1) both groups oppose classroom administration using a public address 
system; 

(2) the control group favor classroom administration by the teacher; 

(3) the control group oppose large group administration In a cafeteria; 

(4) the control group feel that T«V. testing Involves too many problems; 

(5) the escperlmental group tend to indicate a positive attitude toward 
T.V, testing. 

It may be that once teachers have used T.V* administration of tests , 
they are no longer quite so sure that they prefer self •administered testing* 



Tlie results of the study lead to a number of questions: 

(1) Did the teachers unconclously cue the answers when reading 
tiie questions ? 

(2) Is it possible that teacher opposition to T.V. testing 
communicates to the students and effects his performance? 
(Rosenthal effect) 

(3) Did T.V. time intervals, newness of the method of administra- 
tion, etc., contribute to creating a student anxiety level 
which was too iilgh? 

(4) Does teaciier attitude toward self*adininistration change as a 
result of exposure to T.V. testing? 

(5) Is it possible that carefully controlled standardization of 
testing such as T.V .A. mighc lower uational norms? 

Tlie ujC of an instruineat which had been clinically validated but not 
field tested introduces some possibility of erior. For that reason, it Is 
suggested that a standardized test administered to a sample of schools 
via I.T.V. on a similar follov/-up study. The hypothesis is proposed that 
there would be no difference between the T.V. tested group and the teacher 
tested group* 

To insure that no one misinterprets this study the reader is directed 
to the possibility that T.V. niay be a better means of administering tests 
In spite of the results. More careful control over administration might 
result nationwide in a mote v.iH'l St^L of norms. However, these results 
seem to Indicate that standardized testing via T.V. should be limited to 
experimentation 'intiJ more evidence has Loen gathered. 
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